
% United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 
Addrew: COMMISSIONER FDR PATENTS 
P.O. Box 1450 

Aleximdrifl, Vugjuia 22313-1450 
www.u»pt0.gov 



APPLICATION NO. 



FILING DATE 



FIRST NAMED INVENTOR 



ATTORNEY DOCKET NO. 



CONFIRMATION NO. 



09/608,129 



06/30/2000 



Evan F. Wies 



IMM1P104 



2148 



25696 



7590 



09/24/2003 



OPPENHEIMER WOLFF & DONNELLY 
P. 0. BOX 10356 
PALO ALTO, CA 94303 



EXAMINER 



VU, THONG H 



ART UNIT 



PAPER NUMBER 



2142 

DATE MAILED: 09/24/2003 



'7 



Please find below and/or attached an Office communication concerning this appHcation or proceeding. 



PTO-90C (Rev. 07-01) 



Office Action Summary 



Application No. 

09/608,129 



Examiner 

Thong H Vu 



Appticant(s) 

WIES ET AL. 




Art Unit 

2142 



- The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communication(s) filed on 30 June 2000 . 
2a)n This action is FINAL. 2b)S This action is non-final. 

3) 0 Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
Disposition of Claims 

4) ^ Claim(s) 1-45 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 0 Claim(s) is/are allowed. 

6) IE Claim(s) 1-9 and 12-45 is/are rejected. 

7) ^ Claim(s) 10 and 11 is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)n The drawing(s) filed on is/are: a)n accepted or b)^ objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
11 )□ The proposed drawing correction filed on is: a)n approved b)n disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
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1 .□ Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) 0 Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 
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15) 0 Acknowledgment Is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 
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Claims 1-45 are pending. 



Claim Rejections - 35 USC § 102 



2. Claims 1-9,12-45 under 35 U.S.C. 102(e) as anticipated by or, in the alternative, 
under 35 U.S.C. 103(a) as obvious over Mitchell et al [Mitchell 6,349,301 B1]. 

3. As per claim 1 , Mitchell discloses a method for providing a chat interface 
displayed [chat room, Mitchell col 5 line 50-col 6 line 6, col 12 lines 50-67] by a local 
computer, the chat interface capable of providing haptic messages [haptic feedback 
data, Mitchell col 8 line 51 -col 9 Iine13] to other users in a chat session, the method 
comprising: 

causing a display of said chat interface [chat session, Mitchell col 12 lines 50-67] 
on a display device [displayed produced, Mitchell col 10 lines 6-26, col 13 lines 1-11] of 
said local computer [client 226, Mitchell Fig 1]; 

receiving input data from a user of said local computer to said chat interface, said 
input data providing an outgoing chat message, wherein said outgoing chat message 
includes sent force information [force feedback, Mitchell col 8 line 50-col 9 line 13]; 

causing said outgoing chat message to be sent to a remote computer [server, 
Mitchell col 6 lines 29-37] said remote computer connected to said local host computer 
via a network [client-server and Internet, Mitchell col 7 lines 37-54] wherein said remote 
computer outputs a haptic sensation to a user of said remote computer based at least in 
part on said force information [haptic feedback data, forcetfeedback, Mitchell col 8 line 
50-col 9 line 13]; 
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receiving an incoming chat message from said remote computer to said chat 
interface [client-server communications, Internet Mitchell Fig 2, col 7 lines 15-35]; and 

displaying said incoming chat message on a display device to said user of said 
local computer [displayed produced, Mitchell col 10 lines 6-26, col 13 lines 1-1 1]. 

4. As per claims 18,39 contains the similar limitations set forth of claim 1 . Therefore, 
claims 18,39 are rejected for the similar rationale set forth in claim 1 . 

5. As per claim 2, Mitchell discloses said remote computer displays a chat interface 
to said user of said remote computer [chat room, Mitchell col 12 lines 50-67]. 

6. As per claims 3,21 Mitchell discloses said remote computer outputs said haptic 
sensation using a haptic feedback interface device coupled to said remote computer 
[force feedback output devices, Mitchell col 8 line 50-col 9 line 13], 

7. As per claim 4, Mitchell discloses said incoming chat message includes received 
force information, wherein said local computer outputs a haptic sensation to said user of 
said local computer, said haptic sensation based at least in part on said received force 
information [haptic feedback data, force feedback, Mitchell col 8 line 50-col 9 line 13]. 

8. As per claims 5,22 Mitchell discloses said local computer and said remote 
computer are each coupled to a server machine via said network [client-server 
communications, Mitchell col 11 lines 1-53], 

9. As per claim 6, Mitchell discloses said chat interface includes a plurality of 
available haptic effects selectable by said user to be sent as said force information 
[haptic feedback data, force feedback, Mitchell col 8 line 50-col 9 line 13]. 
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10. As per claim 7, Mitchell discloses said force information is associated with sound 
information, such that said remote computer outputs a sound effect in coordination with 
said output of said haptic sensation [sense sound produced, Mitchell col 9 lines 14-38]. 

11. As per claim 8, Mitchell discloses said chat interface allows said user to create a 
custom haptic sensation to be referenced by said force information sent to said remote 
computer [haptic feedback data relative to objects, Mitchell col 8 line 50-col 9 line 13]. 

12. As per claim 9, Mitchell discloses said chat interface includes a plurality of 
buttons (or objects), each of said buttons associated with a particular haptic sensation, 
wherein said user can send said force information causing a particular haptic sensation 
by selecting said button associated with said particular haptic sensation [haptic 
feedback data relative to objects, Mitchell col 8 line 50-col 9 line 13]. 

13. As per claim 12, Mitchell discloses said force information includes a command 
(database), said command being recognized by a chat interface on said remote 
computer to instruct said output of a force sensation to said haptic device coupled to 
said remote computer [client -server interaction Mitchell col 7 lines 16-36]. 

14. As per claim 13, Mitchell discloses said force information includes a network 
address, said address being used by a chat interface on said remote computer as a 
network location at which to retrieve additional force information required to output a 
force sensation to said haptic device coupled to said remote computer [name, owner, 
location Mitchell col 4 lines 63-col 5 lines 2]. 

15. As per claim 14, Mitchell discloses said network address is an address of a web 
server storing a library of standard [Internet, col 7 lines 37-54] and customized haptic 
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sensations which can be output by said haptic device [user change a property of a 
selected artifact col 9 line 50-col 10 line 5]. 

16. As per claim 15, Mitchell discloses uploading custom force information to a 
sen/er at said network address, wherein said uploaded custom force information can be 
downloaded by said remote computer to output a haptic sensation based on said 
custom force information [client-server communications, Mitchell col 11 lines 1-53]. 

17. As per claim 16, Mitchell discloses said force information specifies a particular 
haptic sensation to be output and includes data characterizing said particular haptic 
sensation [haptic feedback data, force feedback, Mitchell col 8 line 50-col 9 line 13], 

18. As per claim 17, Mitchell discloses said chat interface allows said user of said 
local computer to type a text command to cause said force information to be sent to said 
remote computer as inherent feature of chat room. 

19. As per claim 19, Mitchell discloses said incoming chat message includes 
received force information, and wherein said haptic sensation is based at least in part 
on said received force information, and wherein said outgoing chat message includes 
sent force information [haptic feedback data, force feedback, Mitchell col 8 line 50-col 9 
line 13]. 

20. As per claim 20, Mitchell discloses said local computer displays said chat 
interface on a display device, and wherein said remote computer displays a remote chat 
interface to a user of said remote computer, wherein said remote computer outputs a 
haptic sensation to said user of said remote computer based at least in part on said sent 
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force information received from said local computer [haptic feedback data, force 
feedback, Mitchell col 8 line 50-col 9 line 13]. 

21. As per claims 23,44 Mitchell discloses said incoming chat message includes a 
network address, said address being recognized by said chat interface running on said 
local computer as a location at which to retrieve additional force information required to 
output said haptic sensation to said user of said local computer [haptic feedback data, 
force feedback, Mitchell col 8 line 50-col 9 line 13]. 

22. As per claim 24, Mitchell discloses said sent force information specifies a 
particular haptic sensation to be output and includes data characterizing said particular 
haptic sensation as inherent feature of haptic feedback data. 

23. As per claim 25, Mitchell discloses said server machine includes an Internet 
Relay Chat (IRC) server, and wherein said chat interface communications with said IRC 
server using standard IRC protocols as inherent feature of chat session over Internet. 

24. As per claim 26, Mitchell discloses said incoming chat message is associated 
with sound information, such that said local computer outputs a sound effect in 
coordination with said output of said haptic sensation [sense sound produced, Mitchell 
col 9 lines 14-38]. 

25. As per claim 27, Mitchell discloses said incoming chat message is associated 
with one or more displayed images, such that said local computer displays said one or 
more displayed images in coordination with said output of said haptic sensation [avatar, 
Mitchell col7 line 55-col 8 line 20]. 
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26. As per claim 28, Mitchell discloses said network address is an address of a web 
server storing a library of standard and customized haptic sensations which can be 
output by said haptic device [haptic feedback data, force feedback, Mitchell col 8 line 
50-col 9 line 13]. 

27. As per claim 29, Mitchell discloses uploading custom force information to a 
server at said network address, wherein said uploaded custom force information can be 
downloaded by said remote computer to output a haptic sensation based on said 
custom force information [client local database, Mitchell col 7 lines 15-35]. 

28. As per claim 30, Mitchell discloses said chat interface allows said user of said 
local computer to type a text force command to cause said sent force information to be 
sent to said remote computer as inherent feature of chat session. 

29. As per claim 31 , Mitchell discloses said text force command is displayed in a chat 
interface of said remote computer and includes at least one delimiter character for 
indicating the nature of said text force command as inherent feature of chat session. 

30. As per claim 32, Mitchell discloses said text force command is displayed in said 
chat interface of said remote computer and is includes at least one text character of an 
emotion as inherent feature of chat session. 

31 . As per claim 33, Mitchell discloses said incoming chat message and said 
outgoing chat message include data describing text characters for display in said chat 
interfaces, wherein said sent and received force information is also provided as said 
data describing text characters as inherent feature of chat session. 
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32. As per claim 34, Mitchell discloses said input data and said incoming chat 
message are provided as audio data causing an audio output [sense sound produced, 
Mitchell col 9 lines 14-38]. 

33. As per claim 35, Mitchell discloses said input data and said incoming chat 
message are provided as text characters displayed by a display device as inherent 
feature of chat session. 

34. As per claim 36, Mitchell discloses said incoming chat message is provided as a 
waveform that represents speech of said user of said remote computer [sense sound 
produced, Mitchell col 9 lines 14-38]. 

35. As per claim 37, Mitchell discloses said waveform is analyzed by said local 
computer, said analysis detecting content in said waveform which is associated with 
said haptic sensation output by said haptic device [sense sound produced, Mitchell col 9 
lines 14-38]. 

36. As per claim 38, Mitchell discloses said content is indicative of one or more 
emotions in said chat message, and wherein said haptic sensation is associated with 
said one or more emotions [haptic feedback data, force feedback, Mitchell col 8 line 50- 
col9line 13]. 

37. As per claim 40, Mitchell discloses said outgoing chat message includes sent 
force information and wherein said incoming chat message includes received force 
information, and wherein said haptic sensation is based at least in part on said received 
force information received from said remote computer [haptic feedback data, force 
feedback, Mitchell col 8 line 50-col 9 line 13]. 
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38. As per claim 41 , Mitchell discloses said outgoing and incoming chat messages 
include data describing text characters as inherent feature of chat session. 

39. As per claim 42, Mitchell discloses said sent and received force information is 
provided as text characters as inherent feature of chat session. 

40. As per claim 43, Mitchell discloses said received force information is processed 
by a background application running on said local computer simultaneously with said 
chat interface, said background application controlling said outputting of said haptic 
sensation to said user by said haptic device [avatar, Mitchell col 7 line 55-col 8 line 20]. 

41 . As per claim 45, Mitchell discloses said program instructions further perform a 
step of uploading custom force information to a server at said network address, wherein 
said uploaded custom force information can be downloaded by said remote computer to 
output a haptic sensation based on said custom force information [client local database, 
Mitchell col 7 lines 15-35]. 



The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

42. Claims 10-11 are rejected under 35 U.S.C. § 103 as being unpatentable over 

Mitchell et al [Mitchell 6,349,301 B1].in view of Liles et al [Liles 5,880,731] 



Claim Rejections - 35 USC § 103 
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43. As per claim 10. Mitchell did not detail said force information is sent only to a 
subset of a plurality of users in a chat session, said subset of users selected by said 
user on said local computer. 

It was well-known in the art that the user's monitor will display text message from 
selected participants or group of participants whom the user wants to interact [Liles col 
12 lines 1-51][also see Davis, Kohda, Nolan references] 

Therefore, it would have been obvious to one having ordinary skill in the art at 
the time the invention was made to incorporate the technique of user selecting 
participants or group of participants to receive message in chat session as taught by 
Liles into the Mitchell's apparatus in order to utilize the haptic feedback data. Doing so 
would provide the private and security on the chat session. 

44. As per claim 1 1 Mitchell-Liles disclose a plurality of buttons included in said chat 
interface include a set of whisper buttons, which send said force information to only said 
subset of users selected by said user on said local computer buttons [Liles col 13 line 
34-col 14 line 4]. 
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45. Any inquiry concerning this comnnunication or earlier communications from the 
examiner should be directed to examiner Thong Vu, whose telephone number is (703)- 
305-4643. 

The examiner can normally be reached on Monday-Thursday from 8:00AM- 4:30PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mark Powell, can be reached at (703) 305-9703. 

Any inquiry of a general nature or relating to the status of this application should 
be directed to the Group receptionist whose telephone number is (703) 305-9700. 

Any response to this action should be mailed to: Commissioner of Patent and 
Trademarks, Washington, D.C. 20231 or faxed to : 
After Final (703) 746-7238 
Official: (703) 746-7239 
Non-Official (703) 746-7240 
Hand-delivered responses should be brought to Crystal Park 11,2121 Crystal 
Drive, Arlington. VA., Sixth Floor (Receptionist). 

Thong Vu 
Patent Examiner 
Art Unit 2142 



